Evolutionary based black-box adversarial attack. #2215

aliotopal · 2023-07-05T10:22:29Z

Description

I have developed an evolutionary algorithm-based black-box adversarial attack (attack_EA). It is added in evasion attacks section.

Fixes # (issue)

Type of change

Please check all relevant options.

Improvement (non-breaking)
Bug fix (non-breaking)
New feature (non-breaking)
Breaking change (fix or feature that would cause existing functionality to not work as expected)
This change requires a documentation update

Testing

Please describe the tests that you ran to verify your changes. Consider listing any relevant details of your test configuration.

Test A
Test B

Test Configuration:

OS
Python version
ART version or commit number
TensorFlow / Keras / PyTorch / MXNet version

Checklist

My code follows the style guidelines of this project
I have performed a self-review of my own code
I have commented my code
I have made corresponding changes to the documentation
My changes generate no new warnings
I have added tests that prove my fix is effective or that my feature works
New and existing unit tests pass locally with my changes

Paper link: https://www.sciencedirect.com/science/article/pii/S1568494623004155

aliotopal · 2023-07-05T12:48:35Z

Signed-off-by: Ali Osman TOPAL [email protected]

beat-buesser · 2023-07-05T15:07:00Z

Hi @aliotopal Thank you for your pull request! I'll change the target branch to the dev-branch for next release 1.16.

art/attacks/evasion/attack_EA.py

+import logging
+from typing import Optional, TYPE_CHECKING
+
+import numpy as np


art/attacks/evasion/attack_EA.py

codecov-commenter · 2023-07-05T15:41:11Z

Codecov Report

Merging #2215 (72a635d) into dev_1.16.0 (ad7520c) will decrease coverage by 0.74%.
The diff coverage is 0.00%.

❗ Your organization needs to install the Codecov GitHub app to enable full functionality.

@@              Coverage Diff               @@
##           dev_1.16.0    #2215      +/-   ##
==============================================
- Coverage       85.62%   84.88%   -0.74%     
==============================================
  Files             324      325       +1     
  Lines           29323    29458     +135     
  Branches         5405     5413       +8     
==============================================
- Hits            25108    25006     -102     
- Misses           2837     3075     +238     
+ Partials         1378     1377       -1

Files	Coverage Δ
art/attacks/evasion/attack_EA.py	`0.00% <0.00%> (ø)`

... and 4 files with indirect coverage changes

beat-buesser · 2023-08-09T12:34:07Z

Hi @aliotopal Could you please take a look at the Style Checks? You can solve most of the issues by running Black formatter version black==21.12b0 with commands black --line-length 120 art/ and black --line-length 120 tests/.

aliotopal · 2023-09-05T09:11:00Z

Hi @beat-buesser, I have done the style check, it should be ok now. Can you please have a look if everything is ok? Best,

[email protected] The style check is done. Redundant parts are removed.

art/attacks/evasion/attack_EA.py

Fixed trailing whitespaces, blank lines, missing values errors.

aliotopal · 2023-09-25T08:17:46Z

Hi @beat-buesser,
Is there anything that I need to do about the code?

The attack was not compatible with framework libraries, fixed and now works.

art_2 changed with art

aliotopal · 2023-10-09T14:44:34Z

Hi @beat-buesser,
We have updated the code so it is compatible with ART libraries and the attack is working now. It is written in Keras only. Can you please have a look when you have time?

art/attacks/evasion/attack_EA.py

+    # def _get_class_prob(preds: np.ndarray, class_no: np.array) -> np.ndarray:
+    #     '''
+    #     :param preds: an array of predictions of individuals for all the categories: (40, 1000) shaped array
+    #     :param class_no: for the targeted attack target category index number; for the untargeted attack ancestor
+    #     category index number
+    #     :return: an array of the prediction of individuals only for the target/ancestor category: (40,) shaped  array
+    #     '''
+    #     return preds[:, class_no]


Style check errors are fixed.

1. module name changed from attack_EA.py to attack_ea 2. random.shuffle() is removed, it was redundant. 3. x_ is changed to x_temp

aliotopal · 2023-10-12T10:41:54Z

Hi @beat-buesser, I went over the style errors, it should be fine now (I hope).
Style Check:

Module name "attack_EA" doesn't conform to snake_case naming style (invalid-name): changed name to attack_ea
Variable name "x_" doesn't conform to snake_case naming style (invalid-name): x_ changed to x_temp
Argument 1 to "shuffle" has incompatible type "ndarray[Any, Any]"; expected "MutableSequence[Any]: removed function, it was redundant.
generate function arguments are changed according to the superclass.

For the other errors, I don't know what to do.

can you please have a look once more?

aliotopal · 2023-10-17T07:41:34Z

Dear @beat-buesser,

I am sorry, I know I am becoming a pain :(, but when you have time can you please have a look at our attack?

random.choices() problem is solved.

aliotopal · 2024-02-06T14:17:01Z

Dear @beat-buesser,

Finally, style check is giving only this error: "Class name "attack_ea" doesn't conform to PascalCase naming style (invalid-name)" I don't want to change file name, if it is ok. Besides that, there are some more errors in "mypy" but it seems they are not related to our attack. Can you please have a look and give us direction?

aliotopal · 2024-02-06T14:18:33Z

Dear @beat-buesser, Finally, style check is giving only this error: "Class name "attack_ea" doesn't conform to PascalCase naming style (invalid-name)" I don't want to change file name, if it is ok. Besides that, there are some more errors in "mypy" but it seems they are not related to our attack. Can you please have a look and give us direction?

…

________________________________ From: Beat Buesser ***@***.***> Sent: Wednesday, August 9, 2023 2:34 PM To: Trusted-AI/adversarial-robustness-toolbox ***@***.***> Cc: Ali Osman TOPAL ***@***.***>; Mention ***@***.***> Subject: Re: [Trusted-AI/adversarial-robustness-toolbox] Evolutionary based black-box adversarial attack. (PR #2215) Hi @aliotopal<https://github.com/aliotopal> Could you please take a look at the Style Checks? You can solve most of the issues by running Black formatter version black==21.12b0 with commands black --line-length 120 art/ and black --line-length 120 tests/. — Reply to this email directly, view it on GitHub<#2215 (comment)>, or unsubscribe<https://github.com/notifications/unsubscribe-auth/AHW3H3ZMD2PYOWBMT22J3CLXUN7UVANCNFSM6AAAAAAZ6XV37M>. You are receiving this because you were mentioned.Message ID: ***@***.***>

aliotopal · 2024-02-13T10:33:09Z

Hi @beat-buesser<https://github.com/beat-buesser>, I cleared the Style Checks error. There are some error messages from mypy: warpPerspective which has nothing to do with our attack as far as I understand. In CI Keras test: 4 jobs failed, but the error is Error uploading to https://codecov.io<https://codecov.io/> there is nothing that I can do I guess. Please let me know if there is something that I can do. Best, Ali

…

________________________________ From: Beat Buesser ***@***.***> Sent: Wednesday, August 9, 2023 2:34 PM To: Trusted-AI/adversarial-robustness-toolbox ***@***.***> Cc: Ali Osman TOPAL ***@***.***>; Mention ***@***.***> Subject: Re: [Trusted-AI/adversarial-robustness-toolbox] Evolutionary based black-box adversarial attack. (PR #2215) Hi @aliotopal<https://github.com/aliotopal> Could you please take a look at the Style Checks? You can solve most of the issues by running Black formatter version black==21.12b0 with commands black --line-length 120 art/ and black --line-length 120 tests/. — Reply to this email directly, view it on GitHub<#2215 (comment)>, or unsubscribe<https://github.com/notifications/unsubscribe-auth/AHW3H3ZMD2PYOWBMT22J3CLXUN7UVANCNFSM6AAAAAAZ6XV37M>. You are receiving this because you were mentioned.Message ID: ***@***.***>

aliotopal added 2 commits July 3, 2023 12:08

Evolutionary based black-box adversarial attack.

c921f55

Paper link: https://www.sciencedirect.com/science/article/pii/S1568494623004155

Merge branch 'dev_1.15.1' into dev_1.15.0

b184f4f

aliotopal closed this Jul 5, 2023

aliotopal reopened this Jul 5, 2023

beat-buesser changed the base branch from dev_1.15.1 to dev_1.16.0 July 5, 2023 15:07

github-advanced-security bot found potential problems Jul 5, 2023

View reviewed changes

beat-buesser self-requested a review July 6, 2023 15:09

beat-buesser added the enhancement New feature or request label Jul 6, 2023

beat-buesser self-assigned this Jul 6, 2023

beat-buesser added this to the ART 1.16.0 milestone Jul 6, 2023

Merge branch 'dev_1.16.0' into dev_1.15.0

2b79ff1

Update attack_EA.py

c656a5e

[email protected] The style check is done. Redundant parts are removed.

github-advanced-security bot found potential problems Sep 12, 2023

View reviewed changes

art/attacks/evasion/attack_EA.py Fixed Show resolved Hide resolved

Updated attack_EA.py

128ba37

Fixed trailing whitespaces, blank lines, missing values errors.

beat-buesser modified the milestones: ART 1.16.0, ART 1.17.0 Sep 22, 2023

aliotopal added 4 commits September 27, 2023 10:25

Revised attack_EA.py

0394028

Merge branch 'dev_1.16.0' into dev_1.15.0

28ab061

Update attack_EA.py

2584b71

The attack was not compatible with framework libraries, fixed and now works.

Update attack_EA.py

72a635d

art_2 changed with art

github-advanced-security bot found potential problems Oct 10, 2023

View reviewed changes

aliotopal added 3 commits October 11, 2023 09:51

Update attack_EA.py

9482760

Updated attack_EA.py

26df544

Style check errors are fixed.

Update and rename attack_EA.py to attack_ea.py

e3def4a

1. module name changed from attack_EA.py to attack_ea 2. random.shuffle() is removed, it was redundant. 3. x_ is changed to x_temp

beat-buesser modified the milestones: ART 1.17.0, ART 1.18.0 Dec 27, 2023

aliotopal added 4 commits February 6, 2024 11:37

Update attack_ea.py

51530aa

random.choices() problem is solved.

Update __init__.py

e993a72

Update attack_ea.py

562e8bf

Update __init__.py

7aa9ad5

aliotopal added 3 commits February 12, 2024 10:26

Update attack_ea.py

29364d2

Update attack_ea.py

49175ac

Update attack_ea.py

c6c6b3f

beat-buesser modified the milestones: ART 1.18.0, ART 1.19.0 Jun 16, 2024

beat-buesser deleted the branch Trusted-AI:dev_1.16.0 October 1, 2024 15:57

beat-buesser closed this Oct 1, 2024

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Evolutionary based black-box adversarial attack. #2215

Evolutionary based black-box adversarial attack. #2215

aliotopal commented Jul 5, 2023 •

edited

Loading

aliotopal commented Jul 5, 2023

beat-buesser commented Jul 5, 2023

codecov-commenter commented Jul 5, 2023 •

edited

Loading

beat-buesser commented Aug 9, 2023

aliotopal commented Sep 5, 2023 •

edited

Loading

aliotopal commented Sep 25, 2023

aliotopal commented Oct 9, 2023

aliotopal commented Oct 12, 2023 •

edited

Loading

aliotopal commented Oct 17, 2023

aliotopal commented Feb 6, 2024

aliotopal commented Feb 6, 2024 via email

aliotopal commented Feb 13, 2024 via email

Evolutionary based black-box adversarial attack. #2215

Evolutionary based black-box adversarial attack. #2215

Conversation

aliotopal commented Jul 5, 2023 • edited Loading

Description

Type of change

Testing

Checklist

aliotopal commented Jul 5, 2023

beat-buesser commented Jul 5, 2023

codecov-commenter commented Jul 5, 2023 • edited Loading

Codecov Report

beat-buesser commented Aug 9, 2023

aliotopal commented Sep 5, 2023 • edited Loading

aliotopal commented Sep 25, 2023

aliotopal commented Oct 9, 2023

aliotopal commented Oct 12, 2023 • edited Loading

aliotopal commented Oct 17, 2023

aliotopal commented Feb 6, 2024

aliotopal commented Feb 6, 2024 via email

aliotopal commented Feb 13, 2024 via email

aliotopal commented Jul 5, 2023 •

edited

Loading

codecov-commenter commented Jul 5, 2023 •

edited

Loading

aliotopal commented Sep 5, 2023 •

edited

Loading

aliotopal commented Oct 12, 2023 •

edited

Loading